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On  the  Cumulants  of  Cumulative  Processes 


by  Walter  L.  Smith 
(University  of  North  Carolina) 


§1 .  \l  product  ion. 

cumulative  processes  were  introduced  in  1955  as  a  natural  concomitant  to 
the  study  of  what  the  author  called  regenerative  processes  (Smith,  1955).  In 
that  first  paper  some  basic  results  concerning  cumulative  processes  were 
obtained;  these  were  also  explained,  and  the  notions  of  cumulative  and  regen¬ 
erative  processes  further  detailed,  in  Smith  (1958).  For  the  purpose  of  the 

<S  r<CJFAjTTt>. 

present  discussion  we  shall  introduce^ the  cumulative  process  as-follows. _ 

Let  {Xn)”Bj  be  a  positive  renewal  process,  that  is:  an  infinite  sequence 
of  independent  and  identically  distributed  random  (iid)  variables  which  are. 
with  probability  one,  positive.  Let  us  set  S^  »  0  and,  for  n  *>  1,2,..., 

S  ■  Xj  ♦  x,  ♦  . . .  ♦  X  .  Then  suppose  W(t),  for  t  >  0,  to  be  a  stochastic 
process,  such  that  W(o)  -  0,  satisfying  the  following  requirements: 

(Cl)  If  'il  -  W(Xj) ,  and,  for  n  -  2,3 . Yr  -  W(Sn+1)  -  W(Sn),  then 

{ is  a  sequence  of  iid  random  variables. 

(C2)  W(t)  is,  with  probability  one,  of  bounded  variation  in  every  finite 
t-interval . 

(C3)  If  we  set 


W(t)  -  jJjdW(u) 


for  the  associated  "variation  process"  (defining  W(t)  as  identically 
zero  should  W(t)  be  of  unbounded  variation),  then  W(t)  also  satisfies 
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Such  a  process  W(t)  is  called  a  Cumulative  prooeee,  and  since  such 
processes  were  introduced  they  have  been  found  to  have  wide  applicability 
especially  to  problems  in  operations  research.  Typically  W(t)  represents  the 
total  cost,  fuel  consumption,  lost  customers,  and  so  on;  the  time  points 
(sn>  are  so-called  "regeneration  points"  of  the  underlying  process. 

For  r  *  1,2,...,  set  vr  *  E(Y^)r  when  this  nxjtfent  exists  (i.e.  when  the 
relevant  integral  is  absolutely  convergent).  Similarly  set  vr  ■  E(Yj)r,  where 
the  implication  of  the  tilde  is  obvious.  Let  us  also  write  y^  ■  E(X^)r, 

F(x)  =  P{Xj  <  xl  and  Fr(x)  =  P{Sn  x),  for  n  *  1,2,3,...  .  Finally,  when  the 
product  moments  exist,  we  shall  write 


^rs 


\ 


(r  =  0,1,2,...;  s  -  0,1,2,...).  Thus  y^  <*  yrQ  and  Vg  =  y^.  We  similarly  write 
prs  for  product  moments  of  X^  and  Y^. 

In  Smith  (1955),  amongst  other  things,  the  following  was  proved: 

~  2  2  2  2 
Theorem  1.  Suppose  y2  <  00  and  \>2  <  00 •  Let  oj  =  m  -  y^  o2  -  v-,  -  Vj,  and 

pol°2  “  yir  Then*  aa  t  *  “*  Vsr  ~  '  2po1o2(v1/y1)  +  OjCVj/yj)2). 


A  very  special  cumulative  process  is  N(t),  the  veneml  count,  which  gives 
the  number  of  regeneration  points  to  have  appeared  in  the  interval  ( 0, t ] ;  thus 
N (t)  is  the  maximum  k  such  that  Sk  <  t.  In  Smith  (1959)  the  cumulants  of  N(t) 
were  studied,  and  it  was  shown  that  under  a  weak  condition  on  F(k)  and  certain 
reasonable  moment  conditions,  the  cumulants  of  N(t)  are  asymptotically  linear. 


In  more  detail,  if  Vn+.p+y  <  00  f°T  *on'o  n  *  1,2,3,...  and  some  integer  p  ^  0,  then 
there  exist  constants  a  and  b  such  that  the  nth  cumulant  of  N(t)  is  given  by 
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(1.1) 


V  *  bn  * 


where  various  things  can  be  said  about  the  rapidity  of  convergence  of  r^ft)  to 
zero,  as  t  ♦  depending  on  p  and  the  assumption  on  F(x).  We  refer  to  the 
original  paper  for  details. 

These  cumulant  results  could  have  been  substantially  improved  if  the 
results  of  Smith  (1966)  on  general  remainder  terms  in  renewal  theory  been 
available  at  the  time  the  cumulants  were  studied. 

The  object  of  the  present  role  is  to  extend  Theorem  1  considerably  and  to 
demonstrate  that  results  like  (1.1)  car.  be  proved  for  certain  classes  of  cumu¬ 
lative  processes.  However,  a  difficulty  blocking  the  way  of  a  very  general 
treatment  is  that  there  is  such  a  wide  variety  of  possible  behavior  for  W(t1 
between  regeneration  points  even  when  the  distribution  of  the  (Y^)  is  deter¬ 
mined.  To  circumvent  this  difficulty  we  shall  introduce  two  special  classes 
of  cumulative  process: 

Class  A.  Let  ^(xn»Yn)^n.i  8  sequence  of  independent  and  identically  dis- 
tributed  random  vectors  such  that  'xn)nBl  Is  8  positive  renewal  process,  and 
define 


N(t£+1 


W(t)  -  l  Y.  . 


Class  B.  Let  ((X  ,Y  )}  .  be  as  above,  but  define  W(t)  =  0  for  t  <  X  and,  for 

*  n  n  n®  i  j 


t  >  Xj, 


AUv  ion  r  or 

- -TT-S 

y~- 

if  4  lltVi  .v  I 

i 

4 
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The  Class  A  process  can  be  thought  of  as  follows.  At  zero  time  a  cost  is 
levied  for  the  first  regenerative  cycle  of  the  process,  this  cost  Y^  depends 
on  Xj ,  the  duration  of  that  first  cycle.  At  time  Xj  a  further  cost  Y2  is 
levied  for  the  next  cycle,  and  so  on.  Then  W(t)  is  the  total  cost  incurred  in 
the  interval  [0,t].  The  Class  B  only  differs  from  the  Class  A  in  that  one  pays 
for  a  "cycle"  at  its  end,  rather  than  at  its  beginning. 

The  Class  A  and  Class  B  processes  pose  very  similar  mathematical  problems 
with  very  similar  solutions.  This  paper  will  be  devoted  exclusively  to  Class  A 
processes.  However,  at  the  end  of  this  report,  in  §6,  we  briefly  discuss  the 
Class  B  process  and  show  that  the  theory  and  formulae  appropriate  to  that 
process  are  easily  obtained  from  the  theory  provided  for  Class  A  processes. 

The  work  is  heavily  dependent  upon  theorems  which  establish  the  nature  of 
remainder  terms  in  renewal  theory  and  related  topics.  We  shall  depend  very 
much  on  the  results  given  in  Smith  (1966),  and  some  words  of  explanation  are  in 
order  at  this  point.  It  is  possible  that  the  { Xn }  are,  almost  surely,  multi¬ 
ples  of  some  constant  uj  >  0.  If  is  chosen  to  be  maximal  then  we  would  say 
W(t)  is  a  periodio  cumulative  process,  with  period  <a.  If  W(t)  is  not  periodic 
it  is  aperiodic  and  this  report  assumes  throughout  that  W(t)  is  such  an 
aperiodic  process.  There  would  be  a  similar,  and  in  some  ways  easier,  treat¬ 
ment  for  the  periodic  case,  but  we  shall  not  consider  it  in  this  report. 

If  the  marginal  distribution  of  the  (X^l  is  F(x)  *  PlXn  <_  x),  let  us  write 
F^(x)  *  P{X^  ♦  X2  +  . . .  +  X^  x).  If,  for  some  k  =  1,2,...,  F^(x)  has  an 
absolutely  continuous  component  then  we  say  F  is  in  the  class  S.  Throughout 
this  paper  we  must  assume  F  c  S;  this  is  a  technical  assumption  which  is 
unlikely  to  present  any  difficulty  in  applying  the  results  of  this  report  to 
real  problems.  But  the  theorems  of  Smith  (1966)  are  all  based  on  the  hypothesis 
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F  €  S  and  our  statements  about  the  rapidity  with  which  various  remainder 
functions  of  t  tend  to  zero,  as  t  ♦  «,  would  be  false  without  this  hypothesis. 

Let  us  write  ■  Xj  ♦  ...  ♦  X^.  Then  we  shall  see  below  that  the 
so-called  ^-moments: 


(1.2) 


l 

n«0 


♦  t  -  1 
n 


P(S  <  t), 
n  —  * 


for  t  ■  1,2,...,  play  a  crucial  role  in  our  arguments. 

In  Smith  (1966)  a  useful  class  M  of  monotone  functions  M  was  introduced. 

A  function  M(x),  defined  for  0  x  <  09 ,  belongs  to  M  if:  it  is  non-decreasing; 
M(x)  j>  1  for  all  x  >  0;  M(x  ♦  y)  <_  M(x)M(y)  for  all  x  _>  0,  y  _>  0; 

M(2x)  *  0(M(x))  for  all  x  ^  0.  A  function  B(x),  of  bounded  total  variation  on 
(0- ,°°)  is  said  to  belong  to  the  class  8(M;v),  for  some  integer  V  >  0,  if 


C  xVM(x)|dB(x)|  <  -  . 


In  Smith  (1966)  it  is  then  shown  that  if  F  e  8(M,£  ♦  1)  n  S  then 

d-3)  *t(t)  -  P£( t)  ♦  R4(t) 

where  Pt(t)  is  a  polynomial  of  degree  A  in  t  and  Rft(t)  is  a  remainder  term  which 
tends  to  zero  as  t  -*•  »  and  belongs  to  8(M;0).  This  is  true  for  any  integer 
value  of  t  >  1.  Thus  the  following  statements  are  true,  as  t  •»  », 

(!•*)  Rt(t)  -*■  0 


(1.5) 


r  M(u)|dRt(u)|  -  0 


It  is  clear  that  a  Chebyshev  argument  gives  (1.6)  from  (1,5)  and  (1.4).  Thus 
(1.3)  implies 


(1.7)  V«  ■  *  °<  ffTET  >  • 

although,  of  course,  (1.7)  is  much  less  than  is  true. 

In  §2  and  §3  we  shall  prove,  using  these  results  on  <j>-moments  that  W(t) 

does  indeed  have,  asymptotically,  cumulants  which  are  linear  functions  of  t. 

If  K  (t)  be  the  mth  cumulant  of  W(t)  then  Theorem  3.1  will  show 
in 


K  (t) 

m 


A  t  ♦  B 
m 


m 


m 


where  A  and  B  are  constants  and  R  (t)  tends  to  zero  at  a  rate  shown  to  depend 
mm  mv  r 

on  the  tail  behavior  of  G  and  F.  Ensuing  sections  are  then  devoted  to  the 

rather  off-putting  calculations  of  the  constants  (A  }  and  (B  }  which  are,  as 

mm 

in  advances,  increasingly  involved  rational  functions  of  the  product  moments 

p  Q.  Essentially  the  (A  )  are  given  for  m  =  1,...,8  and  the  {B  },  for  the  case 
ap  m  m 

8Yj  =  0  only,  for  m  =  1,...,6. 

In  55  checks  are  discussed  of  the  detailed  formulae  given  for  the  (A  }  and 

m 

(B  }.  In  §6  there  is  a  first  discussion  of  the  Class  B  process, 
m 

We  close  this  introductory  section  with  two  comments  on  the  reason  for  being 
interested  in  the  cumulants  of  cumulative  processes.  In  general,  these  processes 
are  difficult  to  discuss  theoretically  with  exactitude.  But  they  arise  widely 
in  practice  and  it  is  desirable  to  have,  at  the  least,  reliable  information 
about  the  sampling  characteristics  of  sample  means  and  sample  variances.  Thus 
one  can  easily  be  needing  information  on  the  fourth  cumulants  of  W(t) 
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and  even  on  the  sixth  cumulant  if  the  skewness  of  the  distribution  of  W(t) 
should  interest  us.  A  second  reason  for  investigating  these  cumulants  is  that 
we  may  wish  to  approximate  the  distribution  of  W(t)  with  an  Edgeworth,  or 
similar,  expansion  based  on  successive  refinements  of  a  dominant  normal  approx¬ 
imation.  The  need  for  higher  cumulants  of  W(t)  then  quickly  appears. 

Incidentally,  the  rather  long  formulae  for  An  and  B^,  when  n  grows  large, 
are  not  as  unwieldly  as  a  first  encounter  with  them  might  suggest.  We  have 
found  that  certain  hand-held  programmable  calculators  can  be  easily  programmed 
to  provide  Ag  and  for  instance,  for  changing  values  of  the  product  moments. 

Lastly  we  wish  to  acknowledge  that  this  work  was  triggered  a  few  years 
ago  by  an  enquiry  by  the  late  Mindel  C.  Sheps.  In  preparing  her  book  with 
Jane  A.  Menken  (Sheps  and  Menken,  1973),  Dr.  Sheps  needed  detailed  information 
on  the  asymptotic  behavior  of  the  first  few  cumulants  of  a  periodic  cumulative 
process.  Such  results  appear  in  the  book  in  connection  with  interesting 
applications  of  the  theory  of  cumulative  processes  to  mathematical  models  of 
conception  and  birth. 
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§2.  Some  basic  results. 

Let  us  set  G(x,y)  =  P(x^  <_  x,  Yj  y)  for  the  joint  d.f.  of  (X^ , Y^) ,  and 
hence  of  (xn»^n)  for  n  =  2,3,...  ,  We  have  already  written  F(x)  =  P(Xj  <_  x} 
for  the  marginal  d.f.  of  X^;  let  us  therefore  write  H(y)  =  P{Y^  <^y }  for  the 
marginal  d.f.  of  Y^  We  introduce  the  following  notation  for  transforms,  in 
which  s  and  9  are  taken  to  be  real  and  s  >  0. 

-sX. 

F(s)  =  E  e  1 
i9Y 

(2.1)  H(9)  =  E  e  1 

-sX  +i0Y 
G(s,6)  =  E  e  1  1 


Thus  G(s,0)  =  F(s)  and  G(0,6)  =  H( 6). 

Let  £  (t)  =  1  if  S  <  t  and  £  (t)  =  0  if  S  >  t;  we  shall  abbreviate 
n  n  —  n  n 

£n(t)  to  £n  where  no  ambiguity  can  arise. 

Our  argument  will  be  much  clearer  if  we  deal  with  a  specific  case  rather 
than  giving  the  general  argument;  the  way  in  which  a  general  argument  can  be 
constructed  should  be  clear  from  our  discussion  of  the  specific  case,  which  we 
choose  to  be  an  examination  of  the  fourth  moment  of  W(t);  this  particular 
problem  being  sufficiently  non-trivial  to  bring  out  the  features  of  the  general 
argument . 

A.  certain  notation  will  prove  helpful.  If  p^.p^,...,?^  are  integers,  we 
shall  set 


(2.2)  j^(Pj  »P2*  •  •  •  *P^)  =  X  I  •••  I  £ 


r1>r2>. .  .^£0 


P  P2 

-  Y  ,  Y  , 
rt  rj+1  r2+l 


V1 


Thus,  for  example, 
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■  .  L  L  L  ‘r,  Vr,.l  »VI  V*  • 


rl>r2>r^°  1  1 


Now  it  should  be  apparent  from  the  definition  of  a  Class  A  cumulative 
process  that 


(2.3)  W(t) 

l  Vj.  r+1 

r=0 

2 

If  we  note  that  C  C„  =  C.  when  r,  <  r,  and  that  C  =  t  ,  then  a  careful 
ri  r2  Tj  i  l  r  r 

calculation  based  on  (2.3)  yields  the  conclusion: 


(2.4)  (W(t)}4  -  It( 4)  ♦  6  It (2, 2)  *  12  ^(1,1,2) 

♦  12  It (2,1,1)  ♦  12  It (1,2,1) 

♦  24  It(l, 1,1,1)  ♦  4  It(3,l) 

♦  4  It(l,3)  . 

We  wish  to  learn  about  E(W(t))4;  thus  we  must  be  able  to  deal  with  indi¬ 
vidual  expressions  such  that  E  I  (1,2,1),  and  so  on.  This  leads  us  to  consider 
expectations  like 


(2.5) 


E  r  Y  Y  Y 

S  v1  vl  v1 


where  r^  >  r2  >  r^.  But  it  is  to  be  noted  that  Yf  is  independent  of  , 

Y_  .,  and  Y_  This  is  because  C  depends  only  on  S  ,  Thus  (2.5)  sim- 

r2+i  r3+1  rl  rl 

plifies  to  v  E  C  Y2  Y  ,  ,  . 

r  1  rj  r2+l  r^+1  and  hence 


E  1,(1. 2,1)  ■  v,E  I  l  l  Cr  Vj  V 

W*3^°  rl  ~2  r3  1 


(2.6) 


In  notation  already  introduced,  if  and  0 


represent  real  duimny  vari 


ables 


Also  let  us  note  that 


The  manipulations  performed  here  are  easily  justified  if  we  assume  V  exists 


(absolutely)  for  we  can  first  replace  the  Y-terms  by  their  absolute  values,  thus 


making  all  terms  non-negative,  and  we  shall  see  below  that  the  resulting  triple 


series  must  be  (absolutely)  convergent 


}  =  C,(s)C  (s)(F(s) } 


This  result,  used  in  (2.9)  yields 
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(2.11)  /"  e”st  E  L(l,2,l)dt  -  ~  III  C  (s)  C  (s)  tFCs)}1"1  2 

VW° 

c  (s)  c  (s)  l  {f^}T'2 

r=2 

Vj  C t (s)C2 (s) 

2s[l-F(s)]3 


Let  us  set 


5(1, 2,1)  -  PQ  e"st  E  [t(l,2,l)dt, 


with  an  obvious  extension  of  this  notation  to  terms  like  S(3,l),  S(4),  and  so  on. 
Thus  (2.11)  yields 

v  C.(s)C  (s) 

(2.12)  S(l,2,l)  =  — - — - -  . 

2s [1  -  F(s)]A 

Incidentally,  since  F(s)  <  1  for  s  >  0,  the  convergence  of  the  triple 
series  needed  earlier  to  justify  certain  maneuvers  is  any  easy  consequence  of 
the  obvious  finiteness  of  5(1, 2,1).  It  should  be  clear  now  how  one  can  obtain 
a  variety  of  similar  results  which  we  shall  need;  for  some  examples: 


S(4)  ■  »[r~-TETT  • 

v2  C2<s) 


5(2,2) 


s[l  -  F (s) ] - 


S(l. 1,1,1)  - 


VjtC^s)] 


3!  s[l  -  F(s)] 


4  ' 


L 
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The  relevance  of  all  these  S-terms  is  that,  together,  they  give  us  the 
Laplace  Transform  of  E{W(t)}4.  For  (2.4)  shows  that 


(2.13) 


EJ~  e"St  (W(t)}4  dt 

=  S (4)  +  6  5(2,2)  +  12  5(1, 1,2) 

+  12  S(2,l,  1)  12  5(1,2, 1) 

+  24  S(l, 1,1,1)  +  4  S (3 , 1 ) 

+  4  S(l,3). 


Thus  to  gain  information  about  the  asymptotic  behavior  as  t  +  «  of  (W(t)}4  we 
must  look  upon  each  S-term  as  the  Laplace  Transform  of  a  function  whose 
asymptotic  behavior  must  be  separately  determined.  At  this  point  we  will  make 
use  of  the  results  of  Smith  (1966).  But  the  latter  paper,  essentially  dealing 
with  renewal  theoretic  problems  in  which  the  lifetimes  {X^}  are  not  restricted 
to  being  positive,  is  couched  in  terms  of  Fourier  Steiltjes  transforms;  we  must 
therefore  make  certain  necessary  adjustments  to  those  results. 

Consider  5(1,2, 1)  as  a  specific  example.  We  may  regard  s  S(l,2,l)  as  the 
Laplace-Stieltjes  transform  of  some  non-decreasing  function  H(t;  1,2,1),  say. 
Thus ,  from  (2.1  ) , 


(2.14) 


Vj  ^(5)^(5) 


r  =  J”  e'st  H(dt;  1,2,1) 


2 [1  -  F(s)] 


Equation  (2.10)  shows  that  C  (s)  is  the  Laplace-Stieltjes  Transform  of 


(2.15) 


Ck(x)  “  fZ  /^(x.dy) 
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If  M(x)  is  a  moment  function  of  the  kind  introduced  in  §1  and  we  assume,  for 
some  &  «  0,1,2,,.,,  that 

(2.16)  e|X1|*'|Y1|k  M(Xj)  <  », 

then  it  follows  that  C^(x)  «  8 (M; A) .  Moreover  one  can  write 

(2.17)  Ck(s)  -  pQk  -  sulk  4  2fW2k  '  *  ‘TT- wHk  Ptk(s) 

where  Dk(s)  «  8(M;0)  and  is  the  Laplace-Stielt jes  Transform  of  a  function 
D^k(x),  say,  such  that  D^k(x)  =  0  for  x  <  0,  and  Dj^O”)  ■  1.  This  follows  from 
Theorem  3  of  Smith  (1966)  and  Lemma  4  of  Smith  (1959),  with  suitable,  but  fairly 
obvious,  modifications. 

With  reference  to  (2.14),  if  we  assume  temporarily  that  (2.16)  holds  with 
i  =  3  and  k  ■  2,  we  have  that  C^(s)  (^(s)  e  8*(M;3)  and  by  the  same  argument 
behind  (2.16)  we  can  write 

(2.18)  ^(sjC^s)  =  Y0  ♦  sYj  ♦  s2Y2  ♦  s\s  PQ(s), 

say,  where  Pg(s)  e  B*(M;0)  is  the  Laplace-Stielt jes  Transform  of  P  (x)  such  that 
Dp(x)  =  0  for  x  <  0  and  DQ(®)  -  1.  In  (2.18)  the  constants  Yq, Yj.Y,»)t3  are 
rational  functions  of  i>0i  »Mn  ,U21  ,W31  ,V02»M12«V122,V132’ 

On  the  other  hand,  the  same  arguments  allow  us  to  write 

(2.19)  1  -  F(s)  -  v^s  -  jn2s"  *  £  WjS3  F(3)(s)  * 


1 
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where  ^ ^  (s)  is  the  transform  of  the  distribution  function  of  some  positive 
random  variable,  and  belongs  to  8*(M;0), 

In  a  similar  way,  sinco  (2  -  F  (s)}  c  8  * (M ; 3) ,  we  can  show 


(2.20) 


(1  -F(s)}‘  -  vijS*-  -  Pi(*) 


say,  where  Pj(s)  e  8(M;0),  is  the  transform  of  Dj (x)  such  that  D.(x)  =  0  for 
x  <  0  and  Dj  («°)  ■>  1. 

If  we  combine  (2.19)  and  (2.20)  appropriately,  we  find  from  (2.18)  that  we 
can  write 


(2.21)  C^sJC^s)  -  gQ  ♦  gj [1-F (s) )  ♦  g2(l-F(s)]2  ♦  8j83  P^s) 


say,  where  80,8rg2’83  are  rational  Functions  of  p  ,p  ,p  ,  and  the  product 
moments  prs  with  r  -  0, 1,2,3  and  s  «  1,2.  Furthermore  P,(s)  e  8*(M;0)  is  the 
transform  of  D2(x),  say,  where  D^(x)  =  0  for  x  <  0.  \  careful  calculation  shows 

that  D2(<»)  must  be  a  rational  function  of  the  same  moments  and  product  moments 
as  are  g0,...,g3. 

In  Smith  (1959)  certain  convenient  ^-moments  were  introduced: 


(2.22)  $k(t)  =  E(N(t)  +  l][N(t)  ♦  2]  ...  [N(t)  ♦  k],  t  >  0, 

"0  ,  t  <  0. 


It  was  shown  that,  for  k  =  1,2,,,,,  and  s  >  0, 


(2.23) 


C  e'9t  ♦a  Wt) 


tl  -  F(s)) 
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But  (2.14)  and  (2.21)  show  that 


(2.24)  Q  e"St  H(dt;  1,2,1) 


2  [l^(s)]3 


[l-F(s)]2  fl-F(s)] 


V3S  Vs> 

2[1-F(s)]3 


2  T1 


(s)  ♦  V2(s),  say. 


Consider  first  ^(s).  We  can  write 


(2.25) 


*2(s) 


[l-F(s)]' 


and,  by  (2.21),  claim  that 


K(s)  -  C1(s)C2(s)  -  gQ  -  gj (l-F(s)]  -  g2{l-F(s)]; 


Evidently  K(s)  e  8*(M;3)  and  those  will  be  a  K(x)  such  that 


*(s)  -  e'sx  K(dx) , 


Thus  K(-i0)  is  the  Fourier-Stieltjes  transform  of  K(x)  and,  in  view  of  the  fact 


K(s)  -  s^  fl2(s) 


that 
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we  can  easily  show  K(-i0)  ■  O(|0|‘5)  in  a  neighborhood  of  the  origin  6  =  0. 

For  real  0  we  have 

(2.26)  *,(-10)  *  - • 

This  expression  is  in  a  form  suitable  for  the  direct  application  of  Theorem  1 
of  Smith  (1966).  The  conclusion  of  that  theorem  i $  that  there  exists  a  func¬ 
tion  P7(x)  in  B(M;0)  such  that 


V'i6)  "  P2(dx)  • 

However,  as  we  shall  show  a  little  later,  the  variation  of  P2(x)  is  confined 
to  [0- ,<*>).  If  we  assume  this  fact,  temporarily  without  proof,  then 

(2.27)  Y2(-i0)  -  /^_ei0X  P2(d*)  . 

But  P7(x)  is  of  bounded  variation,  so  the  right-side  of  (2.27)  is  continuous  in 
10  >  0  and  analytic  in  10  >  0,  if  we  now  allow  0  complex  values. 

But  F (- i©)  and  K(-i0)  are  also  continuous  in  the  closed  upper  half-plane 
10  ^  0  and  analytic  in  the  open  upper  half-plane  10  >  0.  Recall  that 
|F(-i0)|  <  1  for  all  real  9  +  0,  in  view  of  our  assumption  that  F  e  . 

If  fj(z)  and  f2(z)  are  functions  of  complex  z,  continuous  in  Iz  ^  0  and 
analytic  in  Iz  >  0,  and  if  f^(z)  =  f2(z)  on  the  real  axis,  then  fj(z)  =  f2(z) 
throughout  the  upper  half-plane.  This  is  a  fairly  easy  result  in  complex 
analysis,  best  proved  by  a  conformal  mapping  of  the  half-plane  onto  the  unit 
disc  and  appealing  to  the  Maximum  Modulus  Theorem.  Thus,  if  the  role  of  fj(z) 
is  played  by 
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r0.  «Ux  p,<*0 

and  that  of  f2(z)  by 

K(-iz) 

[1  -  F(-z)]3 

since  (2.26)  and  2.27)  show  f^Cz)  =  f2(z)  on  the  real  axis,  we  may  conclude  that 
for  real  s  >  0, 


*Cs)  . 
[1  -  F(s)]3 


e"SX  P2(dx)  . 


Thus  we  have  shown  that  ^(s),  £  8*(M;0),  is  the  transform  of  P^(x)  whose 

variation  is  confined  to  [0- ,°°) .  We  can  take  P2(0-)  *  0  and  determine  P,!00) 

from  lim  (s) .  Thus 
s-0  1 

s3  V  (s) 

P,(°°)  *  lim  - =- 

2  s-K)  [1  -  F(s)]'i 


P2(0) 


Therefore,  in  view  of  our  earlier  consideration  of  V ^(0) ,  we  may  claim  P2(°»)  is 
a  rational  function  of  Uj,V2»U3»  and  the  product  moments  \i^s,  with  r  =  0,1, 2, 3, 
and  s  =  1,2. 

We  must  now  cover  a  point  glossed  over  earlier,  that  P2(x)  has  all  its 
variation  in  (0-,<»).  To  do  this  we  refer  to  Theorems  4  and  5  and  the  ensuing 
discussion,  in  Smith  (1966).  It  is  shown  there  that  there  exist  constants 
Aj(4),  A2(4),  Aj(4) ,  A4(4),  such  that 
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(2.28) 


1  5  A.  (4) 

- - : - 3  -  I  — 3 - 4-r  ♦  A(0), 

(1  -  FC-10))  j-1  C-Wji 0)  J 


where  A(0)  is  the  Fourier-Stielt jes  Transform  of  a  function  L(x),  say,  which  is 
of  bounded  variation,  identically  zero  for  x  <  0.  But  (2.26)  and  (2,28)  give 


V-i«>  *  l 


4  A.(4)K(-i0) 


♦  K(-i0)  A(0)  . 


j-i  (-M^e) 


It  is  immediate  that  K(-i9)A(0)  is  the  Fourier-Stieltjes  Transform  of  a  function 
identically  zero  in  (-°°,0).  We  therefore  need  only  deal  with  terms  like 


C(-i0) 


for  r  =  1,2,3. 


For  r  =  3  this  term  is  simply  P^t-i©),  and  there  is  nothing  to  prove.  If  r  <  3 
we  must  turn  to  (2.21).  Suppose,  for  instance,  r  =  2.  Theorem  3  of  Smith 
(1966),  especially  the  proof  of  this  result  and  the  accompanying  Lemma  1,  shows 
that  we  can  write 


(2.29)  C1(-i0)C2(-i0)  -  g0  -  gj[l  -  F(-i0)]  -  g2[l  -  F(-iO)]* 


-  (-i0j  P3(0)  ,  say, 


where  (9)  is  the  Fourier-Stieltjes  Transform  of  a  function,  identically  zero 
in  (-<®,0).  This  is  obtained  by  expressing  the  left-side  of  (2,29)  as  a  linear 
combination  of  characteristic  functions  in  B^(M;1),  and  by  noting  that  it  is 
O(|0|3)  near  9=0.  Thus 
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and  the  desired  result  is  obtained. 

We  must  now  hark  back  to  (2.24)  and  discuss  the  significance  of  the  terra 
*^(s).  But  it  is  plain  from  (2.23)  that  'Pj(s)  is  a  linear  combination  of 
transforms  of  the  <J>-moments  <f>j,<|>2,  $3.  Thus  we  merely  need  to  know  about 

the  asymptotic  behavior  of  4>-moments;  this  matter  was  investigated  in  Smith 
(1959)  but,  as  we  have  already  remarked,  more  general  conclusions  are  possible 
if  we  use  the  results  of  Smith  (1966). 

Computation  shows  that,  for  k  ■>  1,2,..., 

00 

<fr.  (t)  “  l  ("^n"1)  P(S  <  t)  . 
k  n-0  n  “ 

Thus  (t )  is  precisely  the  function  covered  by  Theorem  5  of  Smith  (1966),  in 

which  the  substitution  1  =  k  +  L  is  to  be  made. 

The  cases  k  =  1,2,3  are  of  immediate  interest.  Consider  k  =  3,  for  example. 

Here  we  must  take  £  =  4  in  Theorem  5  of  Smith  (1966).  We  must  assume 
4 

E  X  M(X)  <»,  and  can  then  conclude  that,  for  t  >  0, 

^3(t)  *  A33C  +  A32t  +  A31*  *  A30  +  A(t^* 

say,  where  A(t)  ■+  0  as  t  »  and  A(t)  e  P(M;0).  The  constants  A33*A32> • • • »A3o 
are  rational  functions  of  Similar  results  hold  for  <f>  and  $  . 

Thus  we  see  that  4^(s)  is  the  Laplace-Stielt jes  Transform  of  a  function  P^(t), 
say,  such  that  for  t  >  0: 
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Pl(t)  "  *  n2t2  +  Illt  +  %  +  P(*)» 


where  p(t)  +  0  is  t  +  »,  p(t)  e  8(M;0),  and  the  constants  n0»>*->n4  are 
rational  functions  of  •  •  •  >P4- 

If  we  combine  our  findings  on  ^(s)  and  ^(s)  we  obtain  the  following 
result. 

Lemma  2.1.  If  E  X^M(X)  and  E  X3Y2M(X)  are  both  finite,  then  for  t  >  0, 
vj1  H(t;  1,2,1)  «=  kjt3  *  k2t2  ♦  k}t  +  kQ  ♦  p(t), 


where  k^kj.^.k^  are  rational  functions  of  Uj,...,^,  and  the  product  moments 
Wrs  for  r  =  0,1, 2, 3  and  s  =  1,2.  The  remainder  function  p(t)  +  0  as  t  +  ®, 
and  p(t)  c  8(M;0) . 


It  should  not  be  too  difficult  to  see  that  the  treatment  we  have  just 
afforded  S(l,2,l)  can  be  given  any  of  the  S  terms.  For  a  more  general  example, 
let  p^,p2,...,p^  be  k  integers.  Then  one  can  show 


C  (s)C  (s) 


(P^  *P2 *  •  •  •  »Pk^ 


C  (s) 
pk 


(k-1) !  [1  -  E(s) ] 


Let  q  be  the  largest  of  P2,P3» •  •  •  ,Pk-  We  must  assume  E  Xk  |Yj|q  MCX^  <  00  and 
car.  expand  the  C-product  as  follows: 


V” 


8o  +  +  +  g 


k-l 


[l-F(s)  ]k_1  +  g^sk  X?R (s) ,  say. 


In  this  expansion,  the  coefficients  gg.gj, . . . ,gR  will  be  functions  of  Hj ,U2, . . . 
and  the  product  moments  vys  for  r  -  0,1,.,., k  and  s  *  Pj.Pj. • • • .Pj.* 


The  argument  then  goes  much  as  before,  making  use  of  the  ^-moments,  and 
leads  to  the  following. 

Lemma  2.2.  Let  P1*P2, . . . be  k  integers  and.  write  q  ■  max(p2,p3, . . , ,p^) . 
Assume  E  xj*1  M(Xj)  <  «,  E|yJ  1  <  and  E  xJlY^  M(Xj)  <  ».  Then,  for 
t  >  0, 

1  k 

(2.30)  V  H(t;  p,,p2,...,p.  )  -  l  c.tJ  +  p(t)  , 

P1  1  k  j-0  J 

where  the  coefficients  co*ci»  •  •  •  »cjc  030  rational  functions  of  Uj  ,y,, . . .  *Uk+1 
and  of  the  product  moments  yrs  with  r  -  0,1,..., R  and  s  *  V2,py . . . ,pfc.  The 
remainder  function  P(t)  ♦  0  ag  t  +  «  and  p(t)  c  8(M;0). 

We  can  use  this  lenma  to  deduce  the  asymptotic  behavior  of  E{W(t)}4.  From 
(2.12)  we  can  infer  that 

E{W(t)}4  -  H(t;4)  ♦  6  H(t;2,2)  +  12  H(t;l,l,2) 

♦  12  H(t;2, 1, 1)  ♦  12  H(t;l,2,l) 

♦  24  H(t;l, 1,1,1)  ♦  4  H(t;3,l) 

♦  4  H(t;l,3)  . 

If  it  is  supposed  that  EIy^4  <  “,  £  xj  M(Xp  <  •,  and  that  E  X ^ | Yx | s  M(Xj)  <  » 
for  all  integer  r  _<  4,  s  <  3,  such  that  r  +  s  <  5,  then  Lemma  2.2  can  be  applied 
to  each  of  the  above  H- functions  in  turn  and  the  results  establish  that,  for 
t  >  0, 

E{W(t)}4  -  P4(t)  ♦  R4(t) 
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where  P4(t)  is  a  polynomial  in  t  and  R4(t)  is  a  remainder  ten»,  tending  to  zero 

as  t  +  ”,  and  belonging  to  8(M;0).  The  coefficients  of  the  polynomial  P(t) 

will  be  rational  functions  of  P|  •  •  •  »P5*  •  •  •  »v4»  &nd  the  product 

moments  p  such  that  r  <  4,  s  <  3,  and  r  +  s  <  5. 

rs  —  —  — 

We  can  evidently  anticipate  at  this  stage  what  will  be  true  in  the  general 
case;  we  shall  have,  for  integer  m  21  1, 

E{W(t) }m  *  l  H(t;p1,p2,...,pR) 

where  the  £  means  a  sum  over  all  partitions  p^  +  p.,  ♦  ...  ♦  p  =  m,  where  the 
order  of  the  parts  is  significant.  When  we  apply  Lemma  2.2  we  find  the  following 
moment  conditions  arise: 

(i)  Since  one  partition  of  m  is  into  the  sura  of  m  units,  it  is  possible 
to  have  k  *  m.  Thus  we  must  have  E  X^+1  M(X^)  <  °°. 

(ii)  Since  the  H-function  H(t;m)  can  arise,  we  must  have  t | | m  <  ». 

(iii)  If  q  ■  max(p2,p^, . . . ,p^)  is  given,  then  the  maximum  possible  value  for 

k  is  when  all  the  p's  except  the  maximum  one  equal  unity.  This  makes 
(k-  1)  +  q  »  m,  i.e.  k  ♦  q  «*  m  1.  Thus  we  need  E  X*  |  Y  ^  |  ^  M(Xj)  <  00  for 

every  q  £  m  -  1,  k<^m,  such  that  k  ♦  q  <_  m  ♦  1. 

We  have  therefore  deduced  the  following. 

Theorem  2.3.  For  integer  m  _>  1,  assume  E  X™+1  M(Xj)  <  09 ,  E|Yj|m  <  ®,  and 
E  X^|  Yj  | s  M(Xj)  <  <®  for  r  £  m;  s  £  m  -  1,  and  r  +  s^m^l.  Then,  for  t  >  0, 

E  W(t)  m  -  Pit)  ♦  R  (t), 
m  m 

where  P  ft)  is  a  polynomial  of  degree  m  in  t,  R  (t)  -*•  0  as  t  -*•  «,  and 

m  in 
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€  Furthermore, 

of  the  momenta 

that  r<m,  s  <  n  -  !,  and  r  * 


the  coefficient,  in  P^,)  ere  rational  faction. 

v1»v2,...,vm,  and  the  product  momenta  y  auch 

rs 
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wm 


-  s'1  l  {[6(s,0)]AH(e)  -  [G(s.e)]**1} 
A-0 


«C0)  -  G(s.e) 

•n - wM 
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This  formula  is  essentially  that  derived  by  a  much  less  transparent  method 
in  Smith  (1955,  equation  (5.2.11)). 

Let  us  fix  an  integer  k  1  and  choose  another  integer  m  much  larger 

than  k.  For  j  -  1,2 . .  let  be  a  negative  exponential  random  variable 

with  mean  value  X^,  say.  We  assume  Xj . Xffl  are  independent.  Now  define  new 

variables  Y^  -  X j .  Let  a  random  selection  of  the  XlfX2,...,X  be  made,  each 

Xj  being  equally  likely,  and  let  the  resulting  selection  be  called  X.  If  X.  *  X 
then  set  Yj  -  Y.  Thus  we  have  defined  the  probability  distribution  of  the  random 
vector  (X,Y),  and  we  see  that  for  integer  r,s:  - 

m  , 

m  E  XrYs  -  l  XksE  xrS 
j-1  3  3 

-  Cr  ♦  s) I  l  Xks+r+s  . 
j-1  3 

It  will  be  convenient  to  say  (X,Y)  is  generated  by  a  X-model. 

Hence,  if  we  set  u  •  E  XrYs,  then 
rs  ’ 

m  r+(k+l)s  r+(k+l)s 

(r  ♦  s)l  Vrs  “  X1  *  X2  ♦•••(»  terms)  . 

For  simplicity,  let  us  set 

C  .  _ !L_ .  yi 

rs  (r  ♦  s) I  rs 


(3.4) 


■ 


2t> 


The  Argument  we  wish  to  pursue  is  clearer  at  this  stage  if  we  look  at  a 
specific  case.  If  we  choose  k  ■  5  and  m  ■  15 


M 

X. 

4 

A, 

4  , 

,  ,  ,  4 

X 

10 

1 

2 

15 

■ 

x; 

4 

X* 

4  , 

,  ,  ,  4 

•y 

x‘ 

’20 

i 

2 

15 

■ 

x? 

4 

x» 

4  , 

.  •  •  ♦ 

X3 

50 

i 

2 

15 

at 

X4 

4 

X4 

4 

,  ,  ,  4 

X4 

01 

1 

2 

15 

m 

A? 

4 

X* 

4  , 

,  ,  4 

X5. 

11 

1 

2 

15 

«* 

X6 

♦ 

x$ 

4  , 

,  ,  4 

x*c 

21 

1 

2 

15 

■ 

X? 

4 

x7 

4  , 

•  •  ♦ 

X7 

31 

1 

2 

15 

A? 

4 

X* 

4  , 

,  ,  4 

X8 

02 

1 

2 

15 

X15 

X15 

A. 

A 

X15 

33 

X1 

x2 

▼ 

,  ,  ,  ♦ 

X15 

These  equations  establishes  the  vector 


£  *  ^20’  "  *  *  VvO 
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in  Euclidean  Space  of  15  dimensions  as  a  function  of  the  vector 

-  "  (V  X2'  *  *  *  *  X15^  * 

also  in  Euclidean  space  of  15  dimensions. 

If  we  compute  the  Jacobian 

1 

*  J,  say, 


A 
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we  are  led  to  a  determinant  of  the  familiar  Vandermond  type,  and  by  a  well- 
known  representation  of  that  determinant  we  find  that 


J 


(151) 


n  (A  - 
r 

r>s 


V 


Thus  if  X_  be  restricted  to  a  region  D,  say,  in  which  none  of  its  coordinates 
are  equal,  then  J  will  be  non-zero  throughout  D.  It  follows  from  the  theory  of 
implicit  functions  (see,  e.g.  Goursat  (1904),  pp.  45-51)  that  there  will  be 
sphere  E,  say,  in  the  C.-space  and  a  vector-valued  function  X^  =  X_(£)  which  maps 
E  into  some  part  of  D. 

What  we  have  seen  is  that  if  we  are  given  the  product  moments  for 

f  =  0, 1,2,3  and  s  *»  0, 1,2,3,  and  if  these  lead  via  (3.4)  to  a  point  £  in  E  then 

there  exists  a  random  vector  (X,Y),  generated  by  a  X-model.  Plainly  there  is 

nothing  special  about  our  choice  of  k  =  3.  The  above  argument  will  work  for 

2 

arbitrary  integers  k  1;  we  evidently  must  take  m  =  k  -  1.  Thus,  given  k, 
there  is  a  sphere  in  the  space  of  vectors  with  coordinates: 

(Mio’  u2o . uko*  wir  y21'  • 


such  that  these  product  moments  are  all  generated  by  an  appropriate  X-model. 
For  such  a  model 


(3.5) 


■  s  j. 


1 


j-i  i  +  sXj  -  iexj 


If  we  use  the  equation  H(6)  »  G(0,9),  then  (3,3)  gives 

m  ,  m 


(3.6) 


m  V  1  1,1  •  • 

l  (1  -  iex?)"A  -  l  (1  ♦  sX,  -  iexjr1 

M°m  -  j“1  3  J-i  33 

m0(s)  5  —[ 

m  -  [  (1  ♦  sX.  -  i9X.) 

j-1  3  3 


■  “  ■  ~  ■ 
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Thus  Mq(s)  is  a  rational  function  of  s,  it  may  be  expanded  in  partial 
fractions  and  then  easily  inverted  to  yield  Mg(t)  as  a  linear  combination  of 
exponentials.  If  the  poles  of  M?(s)  in  the  complex  s-plane  are  all  distinct, 

v  V6)t 

for  example,  we  would  have  an  expression  of  the  form  Mg(t)  -  I  in 

which  the  critical  numbers  zv(6)  are  roots  of  the  characteristic  equation 


(3.7) 


i  , 

l  (1  ♦  Vi  '  i0V 

j=l  v  J  J 


From  this  it  is  clear  that  there  will  be  exactly  m  such  roots.  It  might  be 
noted  also  that  (3.7)  is  exactly  the  same  as 


(3.8) 


G[z,9)  -  1, 


a  fact  that  will  be  important  later. 

We  may,  with  no  loss  of  generality,  suppose 


X.  >  X,  >  ...  >  \ 

12  n 


Consider  the  function 


m 

G(z,0)  -  ±  [ 


for  z  real.  Evidently  G(z,0)  increases  without  bound  as  z  decreases  from  0 
towards  -X**  .  In  the  open  interval  (-X'1,  -X'1)  it  again  increases  continu¬ 
ously  as  z  decreases,  from  arbitrarily  large  negative  values  when  z  is  near 
-Xj1  to  arbitrarily  large  positive  values  when  z  is  near  -X~l,  This  behavior 
is  repeated  for  the  intervals  (-Xj*,  -X"1),  (-X^1,  -X~ 1 ) ,  and  so  on.  Thus 
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each  of  these  intervals  contains  one  real  root  of  the  equation  G(z,0)  «  1, 
giving  m  -  1  distinct  negative  real  roots.  But  there  is  obviously  a  root  at 
the  origin,  and  so  all  possible  roots  of  the  equation  G(z,0)  -  1  are  accounted 
for  (there  can  be  no  complex  roots) . 

Thus,  by  the  theory  of  algebraic  functions  there  are  m  distinct  functions, 
roots  of  (3.7), 


Zjfe).  z2(0).  •••*  zm(0) 

which  are  analytic  functions  of  the  complex  9  in  some  neighborhood  of  0  *  0. 
Let  Zj(0)  be  that  one  of  these  functions  which  satisfies  Zj(O)  *  0.  Then,  in 
view  of  the  preceding  discussion,  we  may  claim  that,  for  9  in  a  sufficiently 
small  neighborhood  of  0, 

(3.9)  Rzj(9)  <  -Xj*  »  j  *  2,3,. ..,m. 

Thus  we  can  write,  with  a  nod  to  the  partial  fraction  discussion  above, 

tz  (0)  -tX'1 

(3.10)  MQ(t)  -  2^0)6  1  *  0(e  Z  )  , 

where  the  0-term  can  be  shown  to  be  uniform  for  all  sufficiently  small  1 6 j . 
The  function  Zj(9),  by  the  usual  logic,  can  be  calculated  from  the  relation 

(3.11)  2.(9)  -  lim  (z  -  z.(0))M°(z)  . 

1  ^(0)  1  6 


It  follows  from  (3.10)  that 
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(3.12) 


0  “tA2 
log  Mg(t)  -  Zjtej.t  +  log  2^0)  +  0(e  *  )  , 


But  the  left-hand  member  of  this  equation  is  the  cumulant  generating  function, 
and  we  see  from  (3.12)  that,  if  Kr(t)  be  the  r-th  cumulant  of  W(t),  then 


(3.19) 


Kr(t)  -  Art  +  Br  +  0(e  ) 


In  (3.19)  the  constants  Ar  are  determined  by  the  expansion 


(3.20) 


*i(9)  ■  i,  \  ■ 


and  the  constants  Br  are  determined  by  the  expansion 


(3.21) 


log  Zl(0)  *  l  Ml  Br 


We  have  thus  established  the  following. 


Lemma  3.1.  If  a  class  A  cumulative  process  W(t)  is  based  on  a  sequence  {(X  ,Y  )) 

n  n 

generated  by  a  \-model ,  then  the  owiulants  of  W(t)  are  all  asymptotically  linear, 
in  the  sense  of  (3.19). 


Let  us  use  this  result  in  conjunction  with  Theorem  2.3.  For  clarity  we 

shall  be  specific  and  consider  the  third  cumulant  of  W(t);  the  way  the  general 

argument  would  go  will  then  be  apparent. 

Suppose,  then,  that  W(t)  is  based  on  a  general  sequence  {(X  ,Y  )},  i.e.  one 

n  n 

not  necessarily  produced  by  a  X-model,  In  order  to  use  Thoerem  2,3  we  shall 
assume; 
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(a)  E  X*  M(Xl)  <  «; 

(b)  E  lYj3  <  »; 

(c)  E  X[  | Yj  | s  M^)  <  <»,  for  r  =  0,1, 2, 3,;  s  =  0,l,2,r+s<4. 

Let  us  denote  moments  of  W(t)  as  follows: 

(3.22)  Mk(t)  =  E  (W(t)}k  ,  k  ■=  1,2,...  . 

Then  Theorem  2.3  gives 

M3(t)  -  P3(t)  ♦  Rj(t), 

where  Rjft)  e  8(M;0). 

But  conditions  (a),  (b) ,  (c)  are  more  than  adequate  to  deal  withM2(t) 
and  Kl  j (t) ,  and  they  yield  progressively  stronger  conclusions  about  the 
remainder  functions:  - 

W2(t)  =  P2(t)  ♦  R2(t) 

Mj(t)  =  Pj(t)  ♦  Rj(t) 

where  R.,(t)  c  B(M;1)  and  (t )  c  8(M;2).  Thus,  if  we  compute  the  third  cumulant 

K^ft) ,  we  obtain 

(3.21)  Kj(t)  -  P3(t)  -  3P2(t)Pj(t)  ♦  2(P1(t)]3  4  R(t)  . 


The  function  R(t)  is  given  by 
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(3.22)  R(t)  =  R3(t)  -  3R2(t)P1(t)  -  3P2(t)R1 (t) 

♦  ♦  6Px(t)  [RjCt)]2  ♦  2[R1(t)]3 

Note  that  if  f(t)  e  8(M;r)  and  f(t)  +  0  as  t  +  ®,  then 

M(u)ur|df  (u)  |  -*-0,  t  -*•  », 

implies  that  M(t)tr  f(t)  +  0  as  t  +  «.  This  fact  makes  it  a  quick  task  to  show 
that  all  the  terms  on  the  right-hand  side  of  (3.22)  belong  to  8(M;0). 

Thus  Kj(t)  is  shown  by  (3.21)  to  equal  a  polynomial  of  degree  3  plus  a 
remainder  tending  to  zero  and  belonging  to  8(M;0).  The  coefficients  of  this 
polynomial  must  all  be  rational  functions  of  the  moments  prs  with  r  3,  s  <_  2, 
r  ♦  s^  4  and  »P2 »y3»V4*  V1,V2,V3*  T^ese  rational  functions  will  be  the  same 
if  the  {(X^.Y^)}  were  generated  by  a  A-model  with  the  same  marginal  and  product- 
moments.  But  we  have  seen  in  Lemma  3.1  that  in  the  latter  case  all  the  coeffi¬ 
cients  must  be  identically  zero  except  for  the  coefficients  of  the  first  and 
zeroth,  powers  of  t.  Thus  we  have  the  following  result. 

Theorem  3.1.  Assume  the  conditions  of  Theorem  2.1.  Then  Km(t),  the  mth. 
cumulant  of  W(t),  is  given  by 


K  (t) 
m 


At  ♦  B 


m  m 


+ 


where  R (t)  +  0  as  t  +  ®  and  R  (t)  e  8(M:0).  The  constants  A  and  B  are 
m  m  mm 

functions  of  the  moments  •  •  •  *wm+l’  vi  >v->>  >  • « *vm  cm<^  a W  the  product-moments 

Prs  with  r  £  m,  s  _<  m  -  1,  r  +  s  ^  m  1. 
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54.  On  the  calculation  of  the  constants  ^  and  Bn  . 

We  have  seen  that  the  desired  constants  A  and  B  are  rational  functions 

n  n 

of  the  product -moments  p  and  it  follows  from  the  discussion  of  §3  that,  in 

rs 

order  to  determine  these  rational  functions,  it  will  be  sufficient  if  we  assume 
the  (Yn>  to  be  generated  by  a  A-model.  It  follows  from  (3.12)  that,  in  order 
to  obtain  the  (A^),  we  need  expand  z^(0)  as  a  power  series  in  a  neighborhood  of 
the  origin. 

For  low  values  of  n,  the  coefficients  (A^}  are  reasonably  simple  expressions 
but  as  n  increases  the  (A^)  become  increasingly  cumbersome  functions  of  the  pro¬ 
duct  moments  Prs>  Thus  anyruse  which  will  diminish  the  complication  is  desir¬ 
able;  unfortunately,  few  such  ruses  seem  available.  However,  one  that  is  avail¬ 
able  involves  replacing  the  (Y^)  by 


(4.1) 


Y 

n 


Y 

n 


v.X 

1  n 


The  use  of  these  (Y  >  will  substantially  reduce  the  complexity  of  our  formulae, 
n 

But  it  must  be  borne  in  mind  that  these  formulae  will  now  be  expressed  in  terms 
of  the  product  moments 


Thus  a  price  must  be  paid  for  some  degree  of  simplification  achieved  in  the 

formulae  for  the  (A  }. 

n 

We  know  that  Zj(9)  is  the  unique  root  of  (3.8)  which  is  analytic  in  a 
neighborhood  of  0  *  0  and  vanishes  at  0  =  0, 


But,  in  an  obvious  extension  of  our  notation. 
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(4.2) 


-zx+ieY-iv.ex 

5(2,0)  •  E  e 


G( z  *  iv^,  0) 


Thus  we  see 


(4.3) 


21(0)  -  -  iVjQ  , 


which  implies  that  for  all  n  _>  2 


(4.4) 


A  »  A  , 
n  n  ’ 


while 


(4.5) 


A1  =  Ai  -  Vj  . 


Thus,  apart  from  the  tedious  necessity  of  calculating  the  product  moments 

Urs,  there  is  no  difficulty  in  obtaining  the  desired  {\^}  from  the  (An).  To 

avoid  the  frequent  appearance  of  the  tilde  we  may  now  assume  v  =  0;  we  comment 

*  1 

again  at  the  end  of  this  section  on  the  appropriateness  of  our  formulae  to  the 
general  case. 

It  is  well  known,  and  easy  to  deduce,  that  when  =  0  we  must  have 
E  W(t)  »  0  for  all  t  ^  0.  Thus  we  have  at  once  that  A^  =  0  and  may  set 


(4.6) 


00  Av  i 

z,(0)  -  i  rf  (16) ' 

1  k-2  Kl 


Equation  (3.8)  then  yields  the  identity 


(4.7) 


l  E(i6Y  -  x  I  k.  (i0ik)n  a  0 

n-1  ni  k=2 
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Let  6r/rl  be  the  coefficient  of  (i8)r  in  the  expression  on  the  left-hand  side 
of  (4.7).  Then  one  can  deduce  that 


e 


(4.8) 


p,+p  ♦,,,«-p  . 

w  a  /■  •  >  4.  3  S  A-  A 

2S  I  Ir.U-  _ . _  (-JL)  f.2.1  i, 

r!  *  Pl!p2!...Ps!  W  •**  ls!J  Vp^ 


where  the  summation  £  is  over  integers  Pj,P,,...iP  ,  such  that 


(4.9) 


PL  +  2p2  ♦  ...  sps  =  r 


and  we  have  set 


Pj  ♦  P2  ♦  ♦  Ps  -  n  . 

By  examining  all  partitions  of  the  integers  1,...,8  in  turn  it  is  a  fairly 
straightforward  matter  to  obtain  the  following  results. 


^4,10)  63  “  y03  '  3A2W11  +  A3U10 

e4  .  u04  -  6A2u12  .  «,»„  •  3»22u20  -  a4u10  . 

We  also  obtain  but  will  not  quote  them  in  the  interest  of 

saving  space.  At  this  point  it  is  also  convenient  to  adjust  the  X  and  Y  scales 
so  that  Ujq  =  1  and  *  1  (bear  in  mind  that  we  are  supposing  u^j  =  0) .  Since 
every  0^  must  vanish,  by  (4.7),  we  are  led  in  particular  from  the  equations 
(4.10)  to  the  result  A2  ■  1,  by  setting  8,  -  0. 
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If  we  set  the  remaining  0' s  to  zero  and  use  the  values  *  A.,  =  1 

we  obtain  the  following  equations,  from  which  the  A.  can  be  successively 
calculated. 


*3  =  U03  *  *11 


A4  *  W04  -  *12  *  4A3VH  *  *20 


A5  *  U05  “  10U13  "■  10A3W12  *  15M21  '  5A4P 1 1  "  10A3P20 


A6  =  V  '  >*14  *  20Vl3  *  45M22  '  15A4U12  '  60A3W21 


+  6A5U11  '  1SW30  *  10A3y20  +  15A4U20 


A7  =  V  -  21V115  *  35Vl4  +  10*23  “  35A4U13  '  210A3M22 


*  21A5u12  ♦  10SV31  ♦  70A3y21  ♦  105A4U21  -  7A6M11 


21A5U20  +  105A3U30  “  35A3A4U20 


A8  =  M08  "  28U16  +  56A3U15  *  210U24  “  70A4W14  "  560A3y23 


*56Vl3  *  42*32  +  420A4U22  +  280/9*22  ’  28Vl2 
+  840A3W31  -  168A5y21  -  280A3A4u21  ♦  8A7un 


*  10*40  -  21°V25  -  “‘VsO  *  28V20 


-*■  28A6u20  +  SbAjA 5P20  ♦  35A4y20  . 
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We  have  found  that  the  numerical  calculation  of  these  (a  ^coefficients 

n 


is  in  no  way  facilitated  by  solving  the  preceding  equations  for  explicit  repre¬ 


sentations  of  the  (An)  in  terms  of  the  product  moments.  A  computer  program  is 


easily  prepared  to  make  systematic  use  of  the  successive  equations  for 


A3,A4,',,,A8  **  they  are  needed. 


The  coefficients  {B^}  of  Theorem  3.1  are  far  less  important  than  the  (A  } 


since  they  merely  provide  a  second-order  improvement  in  the  formulae  for  the 


cumulants  of  W(t).  Unfortunately,  they  are  much  more  troublesome  to  calculate 


than  the  (A^),  and  no  obvious  simplifying  tricks  seem  available.  If  we  write 


(4.11) 


♦  ( 0)  -  l  (i0)n 


then  it  follows  from  (3.11)  and  (3.3)  that 


(4.12) 


e*(6)  =  •  say' 


where 


(4.13) 


[si  6(s’0)] 


s*t1(9) 


Let  us  write 


(4.14) 


V(e)  ■  tc-  |j)r  G(s,e)J  0  =  l  —  (i9)" 

n=0 


(4. 15)  1.-.  «».»?  .  6(I1(9K8)-G(0’e)  .  y  i^f  *  vce> 

_  i  r! 


■JjO) 


-*j(©) 


I* 


In  order  to  avoid  too  much  complexity  we  shall,  at  this  point,  suppose 
Uqi  a  o.  This  represents  a  genuine  loss  of  generality,  not  trivially  over¬ 
come  as  a  similar  maneuver  was  for  the  case  of  the  (A  ).  However,  our  method 

n 

of  attack  also  becomes  clearer  to  follow.  We  shall  also,  with  no  further  loss 
of  generality,  assume  the  X  and  Y  scales  have  been  adjusted  to  make  =1. 

If  we  were  only  interested  in  terms  up  to  those  in  (i0)4,  the  right-hand 
side  of  (4.14)  equals,  to  terms  of  that  degree, 


A 

v 


-Lr-.qi^ei  *  i  +  Cl(i6)  ♦  ^  tie)2  (i9)4  ♦  o(e5) 


we  can  discover  the  coefficients  CJ,  C^,  ....  say,  in  the  logarithmic  expansion 

i°g  L~y$j-e~l  a  ci(10)  +  if  (i0)2  +-**+  ZT  (i6)4  +  0(e5)  • 


The  easiest  procedure  for  the  calculation  of  the  Cj  is  to  make  use  of  the 
tables  provided  by  Kendall  and  Stuart  for  the  calculation  of  cumulants  from 
moments  (Kendall  and  Stuart,  1958,  p.  70).  In  the  present  instance  we  find: 


C'  3  u 
1  M11 


Cl  -  U 


2  "  H12  "  2  U20  ‘  P11 


C3  M13  "  2  U20A3  '  2  P21  *  3U11W12  *  2  U11P20  *  2P11 


C4  U14  "  2  U20A4  "  2y21A3  +  2W11M20A3  “  3m22  *  M30  “  4U11M13 

*  6W11M21  '  3U12  +  3M12M20  "  4  U20  *  12W11P12 

,  2  ,  4 

-  6VillU20  -  *11  * 


A  glance  at  (4.12)  shows  that  we  also  need  an  expansion  of  log  { -K (0) }  as 

a  power  series  in  0,  if  we  are  to  determine  the  (B  }. 

n 


log  (-K(0)}  -  C”  (i0)  ♦  jf  (i0)2  ♦  .. 


Let  us  set 
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Then,  from  (4.13),  it  follows  that 


K(0)  = 

- 

*  r 

■5?  {  1  FT 

•  — 

~  6(o,0) 

L  r-0 

3or 

o=0 

■i 

^  [*j( 0)]' 

r-0  rl 


^r+1 


3o 


r+1 


G(o,0) 


a=0 


But 


(-1) 


r+1 


,r+l 


3  a 


r+1 


6(0,8) 


o=0 


y  (19) 

j=o 


) 


r+1 , j 


so  that 


-K(6) 


00  [-Z,  (0)  I r  00  -j 

i  nai  ut.i i  > 

r»0  rI  j=»o  r+1'3 


r-1 


“  I"2! (9) ] 

rfi  TT^Ti 


oo  i 


On  comparing  this  expression  with  (4.14)  and  (4.15)  we  see  that  formulae 
^or  Gj >  C^,  can  be  obtained  from  those  for  Cj,  C^,  . ..,  by  replacing  every 

product  moment  PaB  at  every  appearance  in  (4.16)  by  op^.  Thus,  for  example, 
we  can  infer 

C3  "  M13  '  M20A3  '  3lJ21  ’  3wilw12  *  3ullM20  *  2uil  * 

From  (4.11)  and  (4.12)  we  see  that 


Br  “  Cr  -  Cr  '  r  e  1»2»  ••• 


u _ _ _ _ _ * 
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Thus  we  can  deduce  some  easy  rules  for  obtaining  the  (Bn)  from  the  formulae 

(4.16)  for  the  (C*). 

n 

(i)  Eliminate  terms  in  involving  only  product  moments  of  the  type  p j ^ . 

(ii)  A  term  in  involving  only  one  product  moment  Pag  with  a  _>  2 

(possibly  multiplied  by  one  or  more  Mjg);  gets  multiplied  by  -(a  -  1). 

(iii)  A  term  in  involving  two  product  moments  say,  with  a  _>  2 

and  y  ^  6,  gets  multiplied  by  -(ay  -  1). 

It  should  be  obvious  how  these  rules  arise  and  how  they  may,  when  necessary, 
be  extended.  They  lead  to  the  following  results:  - 


B2  "  2  M20 


B3  =  I  U20A3  *  2  y21  *  I  U11P20 


B4  "  2  U20A4  +  2W21A3  '  2ylly20A3  *  3y22  "  2y30  '  6yily21 
-  3y12P20  +  J  P20  +  6yily20 


BS  ■  S|,2J  *  5As“22  *  I  *4U21  *  7  A5M20  '  10l,31  *  T  A3M30 


-  15',n“22  '  10VllU21  •  2  VlAl  *  10l,llU30 

-  1SU12U21  -  5»3u12m20  -  Su20Ujj  *  —  M20U21  ♦  —  »jU20 


*  50u11M21  *  *  50l,ll,,l2“20  ‘  “  "ll^O  ‘  30u‘llu20 
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We  close  this  section  with  the  comment,  promised  earlier,  of  the  effect  of 

the  assumption  v,  =  0.  The  formulae  given  for  {A  }  and  {B  }  are  correct  as 
i  n  n 

they  stand  when  v,  3  0.  If  v,  *  0  then  the  correct  values  for  {A  }  „  can  be 

lx  n  nsz 

obtained  if  every  product  moment  y  used  in  the  formulae  for  the  (A  }  is 

rs  n 

replaced  by  yys  =  EXj(Yj-VjXj)  ;  it  should  be  borne  in  mind  that  the  time  and 

"y”  scales  have  been  adjusted  to  make  y^  =  EXj  =  1  and  E(Yj-VjXj)  =  1, 

something  which  can  be  achieved  with  no  loss  of  generality. 

If  v,  *  0  we  have  provided  no  results  about  the  {B  };  it  is  not  an 
x  n 

impossible  task  to  obtain  them  by  the  methods  we  have  used  earlier  and 
Bj,B2,Bj,B^  should  not  be  too  complicated.  For  the  present,  however,  we  have 
shunned  their  calculation. 


§5.  Checks  on  the  calculation. 


It  is  desirable  to  devise  checks  on  the  formulae  obtained  in  the  previous 

section  since  there  is  plainly  ample  opportunity  for  slips  in  the  calculation 

of  the  (A  }  and  (B  )  for  higher  v&lues  of  n. 
n  n 

If  the  (X  )  are  iid  with  pdf  e~x  and  the  (Y  )  are  independent  of  the  (X  } 
n  r  n  n 

then  it  is  easy  to  see  that  W(t)  is  a  compound  Poisson  process  and,  indeed,  that 

(5.1)  E  =  W(0)  exp-{l  -  H(0)}t  . 

In  this  case  it  is  clear  that 

(5.2)  An  =  Vn  n  =  * 

Furthermore,  if  we  write  (fO  for  the  successive  eumulants  of  H,  then  (5.1) 
makes  it  plain  that 

(5.3)  Bn  =  Kn  n  =  1.2, ...  . 

Thus,  if  we  set  «  0,  and 

(5.4)  ya3  =  (a!)v0 

for  all  relevant  values  of  a  and  0,  then  the  formulae  of  §4  for  (A_)  and  (B  } 

n  n 

should  agree  with  (5.2)  and  (5.3).  We  call  this  the  Compound  Poisson  Check. 

All  our  formulae  pass  this  check  satisfactorily.  Unfortunately,  because 
every  product-moment  like  must  be  set  to  zero  (because  X^  and  are  inde¬ 
pendent  and  Vj  =  0) ,  this  check  give  no  reassurance  at  all  that  terms  involving 
such  product-moments  have  correct  coefficients. 
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A  more  elaborate  test,  which  we  call  the  Double  Poisson  Check  is  as  follows. 

Let  the  Xn  be  distributed  as  for  the  Compound  Poisson  Check,  but  let 

Y  *  1  -  X  .  For  this  model  one  has 
n  n 


(5.5) 


W(t) 


N(t)  ♦  1  -  S 


N(t)+1 


■  N(t)  +  1  -  t  -  S(t), 


where  N(t)  is  a  random  variable  with  a  Poisson  distribution,  E  N(t)  =  t,  and 
S(t)  is  a  non-negative  random  variable,  independent  of  N(t),  with  pdf  e"K. 
Thus  (5.5)  gives 


(5.6) 


E  ei0w(t)  s 


ie 

e 

i  +  ie 


i0 

exp  t(e 


1  -  i0) 


From  (5.6)  we  see  that 


(5.7) 


An  -  1  n  -  2,3,... 


and 

(5.8)  (-l)nB  «  (n  -  1)!  n  =  2,3,... 

n 

For  this  check  it  is  necessary  to  calculate  a  fair  number  of  the  moments 

(5.9)  Mag  =  Q  e‘x  xa(l  -  x)edsc. 

A  table  of  the  necessary  values  is  given  below,  since  their  computation  is 
tedious  once  the  values  of  a  and  8  get  moderately  large. 
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Values  of  product-moments  y^g  for  Double 

Poisson  check 

6  01 

0 

1 

2 

3 

4 

0 

1 

1 

2 

6 

24 

1 

0 

-1 

-4 

-18 

-96 

2 

1 

3 

14 

78 

504 

3 

-2 

-11 

-64 

-426 

-3,216 

4 

9 

53 

362 

2,790 

24,024 

5 

-44 

-309 

-2,428 

-21,234 

-- 

6 

265 

2,119 

18,806 

-- 

-- 

7 

-1,854 

-16,687 

-- 

-- 

— 

8 

14,833 

-- 

— 

-  - 

When  the  values  of  the  product -moments  y^g  given  in  this  table  are  used  in 
the  formulae  for  {A^}  and  {B^}  of  §4,  the  values  obtained  are  in  full  agreement 
with  those  predicted  by  (5.7)  and  (5.8).  This  Double  Poisson  Check  involves 
all  coefficients  involved  in  our  formulae  and  the  fact  that  they  pass  this 
check  strongly  suggests  that  none  of  these  formulae  contain  an  error. 
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§6.  Brief  comments  on  Class  B  Cumulative  Processes. 

Suppose  W(t)  to  be  a  Class  B  cumulative  process  instead  of  Class  A  as  we 
have  been  supposing  throughout  this  paper.  The  arguments  showing  that  W(t) 
has  cumulants  of  the  asymptotically  linear  form  exemplified  in  Theorem  3.1 
will  go  through  much  as  for  the  Class  A  case;  the  remainder  terms  will  have 
the  same  properties.  Furthermore,  the  calculations  of  §3  leading  to  (3.3)  can 
be  imitated,  and  will  lead  to  the  result 


(6.1) 


1  -  F(s) 


Me(s)  =  s  [1  -  G(s',0)l 


It  is  clear  from  this,  as  it  should  be  intuitively  in  any  case,  that  the  coeffi¬ 
cients  (An)  will  be  exactly  the  same  as  for  the  Class  A  process,  obtained  by 
expanding  the  root  z^(9)  of  the  equation  G(Zj(9),0)  =  1.  There  will  be  a  dif¬ 
ference,  however,  in  the  coefficients  (B^h  If  we  once  again  set 


♦(0)  -  l  (i0)n 

n=l  nl 


then  it  can  be  shown  from  (6.1)  that 


(6.2) 


*(8)  1  - 
8  Ij(8)K(») 


where  K(0)  is  as  given  in  (4.13).  This  result  (6.2)  should  be  compared  with 
(4.12)  obtained  for  the  case  of  the  Class  A  process. 

Nothing  but  the  need  for  careful  and  tedious  computation  is  needed  to 
extract  from  (6.2)  the  desired  coefficients  (Bn),  but  we  shall  not  proceed 
further  along  such  lines  in  the  present  report. 


"N 


i 
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